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A NON-LINEaH  renewal  theory  with  APPLiCATlONa 
TO  seouential  analysis  II 

by 

T.  L.  Lai  and  D.  Slegmund 


SUMMARY 

This  paper  continues  earlier  work,  of  the  authors.  An 

analogue  of  Blackwell's  renewal  theorem  Is  obtained  for  processes 

Z = S + C , where  S is  the  n*”*^  partial  sum  of  a sequence 
n n n n ^ 

of  Independent  identically  distributed  random  \rariabies 

with  finite  positive  mean  and  4 is  independent  of  X , ,X  and 

n ^ nti  n-f-z 

has  sample  paths  which  are  slowly  changing  in  a sense  made  precise 
below.  As  a consequence,  asymptotic  expansions  up  to  terms  tending 
to  0 are  obtained  tor  the  expected  value  of  certain  first  passage 
times.  Applications  to  sequential  analysis  are  given 

1.  INTRODUCTION 

Let  X^jX^*...  be  Independent  identically  dlstilouted  random 

variables  with  positive  mean  p and  finite  variance  a^.  net 

S • X,  + . . . + X and  Z • S + 4 » where  tor  each  n 4 is  Inde- 
n 1 n n n n n 

pendent  of  ’ • • • • T^ils  paper  continues  the  program  begun 

by  Lai  and  Slegmund  (1977)  of  developing  a renewal  theory  for  Z^ 
under  conditions  which  guarantee  that  the  sample  paths  of  the  4^^ 


process  are  slowly  changinR  In  a suitable  sense  made  precise  below. 
In  order  to  facilitate  comparison  ot  these  conditions  for  different 
theorems  and  to  provide  a convenient  reference,  the  main  result  of 
Lai  and  Slegmund  (1977)  is  stated  as  Theorem  1.  The  interested 
reader  may  find  the  informal  discussion  contained  in  that  paper 
helpful  in  motivating  the  decomposition  of  and  the  conditions 
imposed  on 

For  b 0 define 


(1) 


T = T(b)  = inf {n  : Z > b} 
n 


and 


(2)  T = T(b)  = infin  : S > b},  = t(0) 

n + 


Theorem  1.  (Lai  and  Siegmund,  1977).  Let  1/2  < a ^ 1 and  assume 
that 


(3) 


b~“(T  - bu"^)  -*•  0 


in  probability.  Suppose  that  for  each  ri  ^ *3  there  exist  n'  and 
p > 0 such  that  for  all  n > n' 


(4) 


p{  max  U . - C I ^ n)  < n 
Cl  1 n 
n< 


If  is  non-lattice,  then 


(5)  Urn  PiZ  -b£x}  = (ES  I P{S  >y}dy  . 

b-^  (0,x]  + 


2 


The  first  results  of  this  paper  are  an  analogue  of 
Blackwell's  renewal  theorem  and  a corollary. 


Theorem  2.  Suppose  there  exists  1/2  < a £ 1 such  that  the  following 
three  conditions  hold: 


for  each  e>0  ^ n^'t}  < 


and  for  each  n > 0 there  exist  n'  and  p > 0 such  that 


^ ^ aP{U,  - Cl>n}<n  (n>n')  . 

n<J£n+pn  ' ^n ' — - 


If  is  non-lattice,  then 


E“p{b<Z  <b  + h}-*-h/u  (b-»”)  . 

1 n — 


"»■»  ’’r  r-n-  rm 
:.i.  !,) 


Corol lary . Suppose  there  exists  1/2  < a ^ 1 such  that  (6),  (7/,  and 
(8)  hold.  Let  p > 0 and  assume  E(X^)^^  < ".  If  b^b^}  Is  a 

family  of  events  and  { ( (C.j.  “ uniformly 

integrable,  then  so  Is  {(Z^-b)^  I , b^b^}.  In  particular,  If 

D 

F.(sup(f;  -C  ,)^)^  < then  {(Z_-b)^,  b>bJ  is  uniformly 
n n-l  i u 

integrable. 

Theorem  2 and  its  corollary  are  proved  In  Section  2. 

Theorem  3 of  Section  2 Is  a somewhat  different  renewal  theorem 
required  by  some  applications  (cf . Section  3) , Theorems  1 and  2 
together  imply  the  main  result  of  this  paper.  Theorem  4,  which 


3 


contains  an  asymptoiic  expansion  for  ET(b)  up  to  terms  which 
vanish  as  h 

In  many  applications  the  behavior  ot  f,  is  governed  hy  a 
2 

term  involving  (S  -npl  /n;  and  to  the  extent  this  Is  so,  diverse 
n 

conditions  on  K mav  be  replaced  by  moment  conditions  on  X,.  For 
technical  reasons  required  by  different  applications  the  statement 
ot  Theorem  4 is  quite  complicated.  Proposition  1 is  designed  to 
facilitate  applications  in  those  cases  in  which  a single  moment  con- 
dition suffices  to  replace  several  of  the  more  cumbersome  conditions 

on  £ . For  motivation  of  this  formulation  and  method  of  proof  see 
n 

Poliak  and  Siegmund  (1975).  The  proofs  of  Theorem  4 and 
Proposition  1 are  given  in  Section  3,  which  also  contains  some 
information  on  Var  T as  b Some  applications  are  discussed  in 

Section  4,  and  Section  5 contains  a comparison  of  the  results  of 
this  paper  with  those  of  Woodroofe  (197ba,  1977). 

Let  ^ . ^((X^,£j),...,(X^.£^)),  n = 1,2,...  . 


Theorem  4.  Assume  that  tot  some  6 > 0 


('C; 


PIT  < 6b}  - oCb'^)  (b  > »)  . 


A.ssume  that  there  exists  a sequence  of  events  A C if  such  that 

n “ n 


(11)  Z P(  U A,  ) s !»  (A  “ complement  of  A)  , 

n , k 
k“n 


and  on  A 


£ - t(n)  + , 

n n 


4 


(12) 


p 


where  for  some  1/2  < a £ 1 the  following  conditions  hold; 

(13)  f : [0,<»)  satisfies  |x^f(x)|  + sup  ^|f(y)-f(x)|  -*•  0 

X<V<X1-X 


as  x V Is  - measurable  and  satisfies 

n ^ n 


(14)  p{8up  k > g}  < “ (e  > 0)  ; 

k>n 


(15)  V converges  In  distribution  to  a random  variable  V ; 
n 


(16)  the  sequence  V - max  „|v  | Is  uniformly  Integrable  ; 

" n<i<n+n  ^ 


and  for  each  ti  > 0 there  exist  n'  and  p > 0 such  that 

(17)  I 


a < n (n>n’) 


n<J£n+pn 


Suppose  is  non-lattice  and  (6)  holds.  Then 

(18)  pET  - b - f(p"H)  - EV  + ES^  /2ES  + o(l) 

*+ 


as  b 


Proposition  1.  Let  Yj^,Y2,...  be  independent  and  Identically  dls- 

~2 

tributed  with  mean  0 and  finite  variance  a . Let  u and  w be 

n n 

random  variables  such  that  for  some  positive  constants  c,  c^  0, 


and  8 
(19) 


*6 

I u -cl  < n and  | w | < c 
' n ' ' n'  - n 


2 

Assume  that  e|Y, < “>  for  some  p > 2.  Let  V ■ u (l"  Y,  ) /n  + w . 

'1'  n n 1 k n 

~ 2 

Then  V V,  where  V has  the  distribution  of  c o Xi ■ Also  V 
n in 


5 


c 


satisfies  (14)  for  anv  oi  ^ 4/p  - 1 and  (16)  for  any  0 < a 1 , In 
addition  for 

0 ' u ^ tnln(p6/2,  p/(p+2))  , 

given  any  n * 0 there  exist  o'  and  p > 0 such  that 

(20)  I Pi  max  |v  -V  |j_n}  < 0 (n_^n')  . 

n^j^n-epn^  " 

In  particular  (17)  holds. 


2.  NON-LINEAR  BLACKWELL'S  THEOREMS 

Proof  of  Theorem  2.  The  notation  below  is  chosen  to  facilitate 
comparisons  with  the  proof  of  Theorem  1 of  Lai  and  Siegmund  (1977), 
which  contains  similar  basic  ideas  although  their  technical  imple- 
mentation is  different. 

Let  a,  n,  and  p be  as  in  the  statement  of  the  Theorem.  Set 


(21)  n^^  • ti~'(b  + h),  - [nj^-on“/4],  - fng  + pnp/4j  , 

By  Lemma  1 below  for  m sufficiently  large  and  fixed,  for  all  suffi- 
ciently large  b 


(22) 


E ^ P{b  < Z < b -t  h}  < n , 
m^n£n^  — n — 


and  also 

(23)  I P{b  < Z <b  + h}  - 0 as  b “ 

n^n^  — n — 

Obviously , 


6 


I 


(2A) 


I P{b<-Z<b  + h)-0  asb-o® 
n<m  — n — 


it  remains  to  estimate  the  series  oi  terms  Ptb  < Z <b  + h}  tor 

— n — 

n,  1 n n,.  For  each  n,  < n ^ n, 

12  1 z 


(25) 


Plb‘Z<-b-th)<P\^-'-  n) 
— n—  — n n.  — 

1 


+ P{b-ri''Z  -t-CS  -S  I'^b-th  + n) 
- r.  - 


By  (8)  and  (21)  for  all  large  b 


(26) 


Furthermore, 


I >n>  < n 

n^'-n<n2  n n^^ 


(27)  I ^ ^ Plb  - n < Z + (S  - S ) < b + h + r)}  = Eg(b  - 7.  ) , 

n^<n<n2  — n^^  n 


where 


(28) 


g(t)=Z.  Pt,t-n<-S  <(t-ri)+n+2r|} 

j<n2-n^  - j- 


It  will  be  shown  in  Lemma  2 below  that  as  a consequence  of 
Blackwell's  Theorem 


(29) 


Eg(b  - Z ) ■►  (h  + 2n)/  M 
"l 


Then  by  (22),  (23),  (2q),  (25),  (zb),  and  (29) 


llm  sup  L.  p{b  < Z <bth)  < 2n  -t  (h+2o)/d 
, 1 — n — 

b-«» 


Letting  n 0 gives  one  inequality.  The  inequality  iri  the  other 
direction  follows  by  a similar  but  easier  argument,  which  completes 
the  proof. 


I 


Lemma  1 . Under  conditions  (b)  and  (7)  for  m sufficiently  large  and 
fixed,  for  all  large  b (22)  bolds:  also  (2J)  holds. 

Proof . Let  0 < f.  < pu/9.  Note  that  for  all  large  b and  n ^ n^,  if 

Ot  Cl 

S - nu  > - En  and  ^ - tn  , then  by  (21) 

n — n — 

S + C > nu  - 2en*^  > n^U  - 2En^  > n.u  = b + h 
n n — — 2 2 0 

From  (6)  it  follows  that  Z P{|S^-n.j|  ’n*^G}  < °°  (cf . Baum  and  Katz, 
1965,  Theorem  3)  and  hence  by  (7)  as  b 

E P{b  < Z < b + h>  < Z (P{  is  - nul  > tn“}  + P{  U I > en“})  - 0 . 

— n—  — n_;^n2  n ' n' 

This  proves  (23),  and  (22)  follows  by  a similar  argument  if  m is 
chosen  so  large  that 

Z (P{|S  -nu|  > en°‘}  + P{|^  1 >£0°^})  < n 
n_>m  ' n ' n ' 

Lemma  2 . Under  conditions  (7)  and  (8),  for  g defined  by  (28),  the 
limit  (29)  holds. 

Proof . It  suffices  to  show 

(30)  g(b-Z  ) - (h+2n)/M  a.s.  (b+«>) 

"l 

and  that  g is  bounded,  for  then  (29)  follows  by  dominated 

convergence.  Let  v(b)  = n^  - n^ . By  (7)  and  the  strong  law  of 

numbers  Z - un,  + o(n'?)  « b - pu^  + o(b^)  . Hence  by  (28), 

n j 1 1 

to  prove  (30)  it  suffices  to  show  that  for  arbitrary  real  numbers 

/LX  lOI/,  . /L®X 

z(b)  * PU  b /A  + o(b  ) 


8 


(31)  , p{z(b)  < S < z(b) +h+ 2n}  - (h+ 2n)/u  . 

J<V(b)  — j — 

But  If  j ^ V(b)  and  then  by  (21)  S.  ^ h^/3  + o(ll 

> z(b)  + h + 2n  for  all  latKe  b,  and  it  follows  that 

=:j>v(b)  fts,i..(bi^h»2n)  i p|s^<2iu/j.  •" 

Thus  (31)  and  with  It  (JO)  follow  from  BlacKwell's  Theorem.  That  g 
is  bounded  Is  a consequence  of 


g(t)  < 1 + l"  „ P*.  - h - 2r|  < S < h + 2p} 
— n=0  — n — 


The  series  In  (32)  converges  because  the  random  walk  IS  } Is 

n 

transient  (cf.  Feller,  1966,  pp.  199  ff.). 


Proof  of  Corollary  to  Theorem  2.  Assume  E(sup(?',  -f  ,)^)*^ 

n n-1 

n^l 

For  X > 0 and  all  large  b 


P{Z.„  - b -•  2x}  < - P(Z  < b,  Z + X > b + x} 

T — — n=n  n—  n n+1 — 


+ P{sup (^  - ^ , )^  > x} 


n n-1  — 


E „P{Z  <b.Z  t-X  >b  + x)=)  P{X  >b+x-y}E  „FlZedy} 
n-O  n-  n n+I—  , 1-  ii=0  n 

(-*,6] 

(34)  < P{X,  -•  b + x - k}  E'*  . P{k  - 1 < Z < k} 

— k--«>  1 — n»0  n — 


< const. (/"  P{X,  > y}dy  + P{x,  > x - l}) 

— X 1—  1— 


To  see  the  last  inequality  in  (34),  note  that  by  Theorem  2 there 


1 


oo 

exists  cl  k.  such  that  tor  all  k ' k.  7.  „ P{k‘  7,  ' k+l;  < 2/iJ, 

0 — 0 n=n  n — — 

while  (6)  and  (7)  Implv  /.  Pi7  • k„ -t- 1 > < ^ (cf.  Baum  and  Katz,  1965, 

n — IJ 

Theorem  3l  . The  uniform  integraMlity  of  (7^-b)^  follows  from  (33) 

and  (34).  If  only  { ( ( f).j,  - )'^  } is  .issumed  to  he  uniformly 

b 

inteprable,  (33)  may  be  replaced  by  P(1Z_  - b > 2x)  A.  ) 

r — b 

< r.^  P{Z  - b,  7 -rx  >b  + x}  P({4-f  , ^xj /•  , A ) , 

— 0 n nn+1—  TT-1—  b 

and  the  rest  of  the  proof  follows  as  above. 

The  following  theorem  is  equivalent  to  one  of  the  main 
results  of  Woodroofe  (197ba)  in  a number  of  special  cases,  although 
its  abstract  formulation  and  proof  are  different.  (See  Section  5 
for  a more  systematic  comparison  of  the  results  of  this  paper  with 
those  of  Woodroofe,  1976a.) 

Theorem  3.  Suppose  there  exists  1/2  < a ^ 1 such  that  conditions 
(6)  and  (7)  hold,  and  for  each  t]  > 0 there  exist  n'  and  p > 0 such 
chat 

(35)  E Pi  max  T,  l^n}  < n (n_n') 

n£j£^n-t-pn*^  ^ 

If  is  non-lattice,  then  for  all  y > 0 

(36)  E*  _ P{T  -0,7  > b - y}  ^ PiS  > t for  all  n ' 0)dt  . 

n=0  n -y  n — 

Proof . Like  Theorem  2 Che  proof  of  Theorem  3 conslst.s  of  reducing 

the  general  case  to  the  case  ^ =0.  This  reduction  is  similar  to 

n 

the  proof  of  Theorem  2 and  Is  omitted.  However,  unlike  Theorem  2, 

which  reduces  to  Blackwell's  Theorem  In  the  case  ^ =0,  the 

n 

10 


J 


corresponding  version  of  Theorem  J does  not  seem  to  have  appeared  in 

the  literature  (although  under  stronger  assumptions  It  is  Implied  by 

Theorem  3.1  of  Woodroofe,  197f)a)  . 

Assume  then  that  ^ = 0 so  that  Z = S and  T = i . Let 

n n n 

M = max(0,S, , . . . ,S  ) and  M*  = min(0 ,S  , S- , . . . ) . Then  Ob)  becomes 
n in  1 / 

(37)  l”  „ PlM  <b,  S -b-v}  * J PfM*  'tMt  . 

n=0  n-  n 

Let  0(n)  denote  the  n*"*^  (strict)  ascending  ladder  time,  i.e., 
a(0)  = 0 and  for  n ^ 1 o(n)  * inf  in  : n > a(n  - 1) , ^ ^ 

(o(l)  » T,).  Let  T = tnf{n:n>l,  S <0}.  By  considering  the 
(uniquely  defined)  smallest  index  k £ n for  which  one 

obtains  for  0 ^ y < b 

P{M  < b,  S > b - y}  = Z“  . / P{S,  < S,  V I < k,  S e dx, 

n—  n k=0  , 1 i k k 

(b-y,b J 

S s s ,'!/ k < 1 < n,  S - S > b - V - x}  . 

Summing  these  terms  for  n = 0,..,,  and  reversing  the  order  of  sum- 
mation yields 

(38)  E*  „ P{M  < b,  S > b - v) 

n-0  n—  n 

- e"  o e”  , I P{S  <S,  T'K  k,S,  e dx}P{T,  >n-k,S  >b-y -x} 

k-0  n-k  .ilk  k + n-k 

(b-v,b J 

-/  e"  - P{t  >n,S  > X - v}e”  Pis  < S V i < k,S  G b - dx}  . 
f_  . n*0  ^ n ic*u  IK  K 

10,  y) 
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I 


Now 


■O  A 


^k-0  Sj^  t b - dx;  = P{o(n)  = k,  f,  b - dx} 


(39) 


= 5:  . P{S^  , . E b - dx} 

n=0  0(n) 


Since  P{t  - n,  S x-y}  - PiS  -S  <0  /0<l<n,  S >x-y),  it 
+ n ni—  — — n 

follows  that 


(^0) 


S >x-y)=I  ^P{S  >S  ■0<l<n,  S >x-y, 
n n=n  1-  n — — n ’ 

S . > S r j > n}/P{T  = ®} 

J n 

= Et^  P(M*>x-y}  (0£x<y) 


The  last  equality  uses  the  well  known  fact  that  Et^  = 1/P{t  * »} 

(cf.  Feller,  1966,  p.  379).  Since  P{M*  > t)  is  decreasing  in  t, 
applying  Blackwell's  renewal  theorem  to  the  right  hand  side  of  (39) 
and  taking  into  account  (38),  (39),  and  (40)  yields 


e“  „ P{M  < b,  S > b - y}  - Et^  / P{v*  . X - y}dx/ES 
n=0  n—  n T 

fO.y) 

P{M*>t}dt 

(-y.o] 


2 

Remark.  The  condition  that  0 = Var  ® was  not  used  in  the 

preceding  proof  for  the  special  (.se  £.  =0. 

n 


3.  EXPANSIONS  OF  ET(b)  AND  Var  T(b) 

Intuitively  the  random  variables  Z and  T(b)  are  the  same 

n 

variables  in  Theorem  4 as  in  Theorems  I and  2.  For  technical 


I 


12 


reasons,  In  the  proof  that  follows  new  random  variabJes.  and  T'(b) 

will  be  defined  in  terms  of  the  original  Z and  T(hi,  and  fhforems  I 

n 

and  2 will  be  applied  to  these  new  variables. 


Proof  of  Theorem  4.  Let  he  a sequence  ot  positive  numbers 

tending  to  n to  be  further  specified  below.  Since  f(x)  = o(x'^),  ter 

appropriately  chosen  there  exists  an  Integer  su..h  chat 

( f (x)  I < for  all  x ^ n ^ n^.  Let  L^^  =•  sup  in  ;A^  occurs), 

L.  = sup{n  : | V I > e n'^) , L,  = sup  in  : 1 S - nu  1 ^ E n°^  ‘ , and 
2 'n'—  n 3 'n  '-n 

L = 1 + max(nQ,Lj^,L2,L^)  , By  (11)  EL^  < By  (b)  (tf . Baum  and 

Katz,  1965,  Theorem  3)  and  (14)  for  appropriately  chosen  It  } 

n 

EL^  < “ and  EL^  < Hence,  EL  < «>. 

Let  £’  = 0 for  n < n,,  and  for  n > n„  set 
n — 0 0 

Letz'aS  + C',T'(b)  = inf  {n  : Z'  -*  o) , 

^n  ^nAiV  <en)  n n n’  n ’ 

n n n 

and  B - B,  “ {l  < mln(T,T') }.  Note  that  jC'|<2e  n*^  for  all  n, 

^ n ““  n 


For  all  £ > 0 for  sufficiently  large  b on  B 


(41)  = T ' Z,.  - Z',  , ard  bu“^  - eb'^<T'  < bu~^  -r  Eb^^ 

D b T,  I. 

b b 

The  two  equalities  in  (41)  are  obvious.  The  inequality  in  (4l) 
follows  from 


b < Z,J..  < uT*  + 3e^.(T')“ 


and  the  corresponding  inequality  for  T - 1,  which  hold  on  B.  Hence 


by  Wald's  leir 
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(42)  met  - / S^dP  - /pS^,  dP  - bP(B)  + -b)dP  - /g  dP  . 

B 

It  will  be  shown  in  Lemma  3 below  that 

(43)  b P(B)  - 0 
and  in  Lemma  4 that 

(44)  / S dP  0 , 

B ^ 

as  b It  is  easy  to  see  that  condition  (3)  is  satisfied  for  the 

random  variables  T'  and  hence  with  the  help  of  (15),  (16),  (17), 
(41),  and  (43) 

(45)  /g  dP  = f(b/M)  + EV  + o(l)  . 

Finally,  it  will  be  shown  in  Lemma  5 as  an  application  of  Theorems  1 
and  2 that 

(46)  4 (z;,  -b)dP  > Esl  /2ES, 

B T V ‘ + 

Relations  (42)-(46)  yield  the  theorem. 

Lemma  3 . Under  the  conditions  (6),  (11),  and  (14)  the  relation  (43) 
holds . 

Proof . The  conditions  of  the  lemma  imply  that  EL  < where  L is 
defined  as  in  the  proof  of  Theorem  4.  To  prove  (43)  it  suffices  to 
show  that 

(47)  b P{T  < L}  0 
and 
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(i,8)  b P{T’  < L}  0 . 

Now  for  arbitrary  5 > 0 

P{r_<L}  f P{L^6b}  + P{T£6b} 

< (6b)"^  ; LdP  + P{T < 6 b) 

{L_^6b} 

Hence  (47)  follows  from  (10)  and  the  flnlteness  of  EL.  Since  by 

definition  |C'I  2g  n®,  It  may  be  shown  that  bP{T'£6b;  -»  0,  and 
n n 

then  (48)  follows  from  a similar  argument. 

Lemma  4.  Under  the  conditions  (6),  (11),  and  (14)  the  relation  (44) 
holds 

Proof.  By  th«  Schwarz  Inequality  and  Wald's  lemma  for  squared  sums 

j;  S dP|  - \ L (S  -yT)dP  + y/^TdP| 

B B B 

< {E(S:  - mT)^  P(B)}^'^  + y / TdP 
^ B 

- {O^  ET  P(B)}^'^^  + y / LdP  f ,i/  i 

{T<L}  {T'<L-I} 

It  is  easy  to  see  that  ET  - 0(b)  and  hence  by  Lemma  3 

E(T)P(B)  - 0 (b-^“)  . 

The  conditions  of  the  lemma  imply  EL  < “ and  hence 

To  complete  the  proof  It  remains  to  show 


dP. 
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TdP  - 0 


If  T > L,  then  ls^_^  - u(T  - 1)  | < T®  and  < e^T®,  so 

b > S^_j^  + :!  U(T-l)  - 3T°^.  Thus  for  all  large  b 

{T  > L} d {T  < 2b/u}  and  it  follows  that 

/ T dP  < 2b/p  P{T'  < L}  -►  0 

{T'<_L<T> 

by  Lemma  3.  This  completes  the  proof. 

Lemma  5.  Under  the  conditions  of  Theorem  4,  the  relation  (46)  holds. 

Proof.  Lemma  3 and  (41)  show  that  condition  (3)  holds  for  the  stop- 
ping times  T'.  Also  the  conditions  of  the  corollary  to  Theorem  2 
are  satisfied  with  the  events  A of  the  corollary  being  the  events  B 
defined  In  the  proof  of  Theorem  4 (recall  especially  (13),  (16),  and 
(41)).  It  follows  from  Theorem  1 that  Z^,  - b converges  in  distri- 
bution and  from  the  corollary  to  Theorem  2 that  the  (Z',-b)I  are 

T 

uniformly  Integrable.  The  lemma  now  follows  by  simple  computation. 

Proof  of  Proposition  1.  The  convergence  In  law  of  Is  Immediate 
from  the  central  limit  theorem.  That  (14)  Is  satisfied  provided 
p ^ 4/(1+ a)  follows  from  Theorem  3 of  Baum  and  Katz  (1965). 

Let  The  calculations  given  below  prove  (16)  and 

(20).  Several  applications  are  made  of  Kolmogorov's  Inequality  for 
submartingales  (cf.  Chow,  Robbins,  and  Slegmund,  1971,  p.  24)  and 
the  inequality 

(50)  e1u^|P  < C n’’^^ 
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(cf.  Doob,  1954,  p.  225).  Here  and  In  what  follows  C denotes  Lon- 
stants  which  may  differ  from  one  appearance  to  the  next.  The  proof 
of  (16)  Is  an  immediate  consequence  of  the  inequalities 

P{  max  >x)<P{  max  H > nx} 


n< i^n+n 


a'  1 


< (nx)"’’^^  E|U  I"  < C x"P^^ 

[ n+n^ ] 


To  prove  (20)  note  that  for  1 > n 


u.  Uj/1  - U /n  “ n ^U^(u  -u  ) 
11  n n n 1 n 


+ u,{l”^(lt  -u  )^  + 2l‘^U  (U,  -U  ) - (nl)“^(l  -n)U^}, 
1 1 n n 1 n n 


Hence  (20)  Is  a consequence  of  the  following  Inequalities. 

j.^pn  1~^(U  -U  )^>ri}  < P{  max  ju  -U  l^>r|n} 

J""  n<i<J  ^ " ~ n<i<j  ^ " 


< (nn)‘P^^  E|U^-U^lP 


< C(nn)-P^2  j-n-fpn 
- J-n 


< C(nn)"P^^  (pn“)^ 


+ 1 


P{  ma/.  r-^lu  (U,  -U  ) | > n) 
n<l<j  " ^ " 


.-1. 


< EfPf  max  |U  -U  | >nr)/|u  |ju  }] 

” J " n<l^  * " " ' " 


(nn)'P  (pn“)^ 
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a 

j-nt-Dn 

.1-n 


Pi  max  (i-n/))ll  /n>n}  On  P{n  U > n n /p} 
n — — 

n<‘ l<  j 


n — 


c D(p/n)^^^ 


-^  + ci(l  + p/2) 
n 


u 

j.n+On 

M-n 


P{n 


-J 


n 


max 

n^t<j 


u I > n)  < P{n  ^ (2n  > n) 

n — n 


c p n 


-p/2 


u-6p/ 2 
n 


The  preceding  results  show  that  to  a first  order  approxima- 
tion the  behavior  of  and  T is  asymptotically  the  same  as  that 

of  and  T,  although  differences  appear  with  higher  order  asymp- 

totic expansions.  According  to  Chow,  Robbins,  and  Siegmund  (1971, 

2 3 

p.  31)  Var(T)  ~ 0 b/u  as  b -*•  ‘®;  and  it  should  come  as  no  surprise 

that  under  conditions  similar  to  those  of  Theorem  4,  one  may  show 
2 3 

that  V'ar  T ~ 0 b/y  also.  Indeed,  such  a result  has  been  proved  by 

a different  method  and  applied  by  Woodroofe  (1976a,  1977)  In  several 

special  case.s . The  details  of  such  an  analysis  seem  sufficiently 

similar  to  the  proof  of  Theorem  4 that  they  have  been  omitted. 

It  would  be  more  in  the  spirit  of  the  present  paper  to 

obtain  an  expansion  for  V'ar  T up  to  terms  which  vanish  as  b 

Unf or tunately , the  authors  have  been  unable  to  produce  such  a result 

even  in  the  simplest  special  (non-linear)  cases.  For  the  linear 

case.  In  which  C = 0,  Z “ S , and  T • T,  it  is  possible  to  obtain 
n I n n 

an  expansion  of  Var  T » Var  T up  to  terms  which  vanish  as  b as 
an  application  of  Theorem  3.  This  result  seems  to  be  new  except 
under  the  further  assumption  that  ^ 0 — see  Smith  (1959)  . 
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+ 3 

Theorem  5.  Assume  that  F.(Xj^)  < «>  and  is  stronRlv  non-laitlce  in 

the  sense  of  Stone  (1965).  Then  as  b -*■  “* 


(51)  Vir  T - u'^o^b  + K + o(l) 
where  K Is  given  by 

K - a^ES^  /2uES  +7{ES^  /ES  - 4 ES^  /ES 
T , ^ T . T 3 T T 

+ + + -t-  + + 

(52) 

-(ES^  /ES  )E{mln  S }-2  f ElS  . - x}p{mln  S < - x}dx 
^ 0 T(x)  n- 


Proof . It  Is  well-known  (and  is  the  linear  case  of  Theorem  4)  that 


as  b “ 

(53)  yET  - b + ES^  /2  ES^  + o(l) 


Similarly,  for  i • 1 or  2 

(5A)  E(S  -b)^  - (ES^  )“^  / P{S  >x}dx  . 

+ (0,“) 

2 

Also  Et  < ®,  so  by  Wald's  lemma  for  second  moments  (cf . Chow, 

Robbins,  and  Slegmund,  1971,  p.  23)  and  elementary  algebra 

Var  T - E(yT  - S^  + S^  - y Et)^ 

- E(s^  - yt)^  + E(S^  - y et)^  - 2 E[(S^  - yt)  (S^  - y Et)  ] 

(55) 

- o^Et  + E(S^  - b + b - yET) ^ - 2E[(S^-b  + b-yt) (S^-b  + b-yEt) ] 

- O^Et  - (yET  - b) ^ - E(S^  - b) ^ + 2E{ (yT  - b) (S^  - b) } . 
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Hence  hv  (fi^)  and  (i^t) 


M^Var:  - o^b/u+o^ES^  /2^ES  fES^  /ES 


- ES^  /3ES,  + a(])  + 2MEf(l-ET)(S  - b) } 


It  remains  to  evaluate  the  last  term  on  the  ripht  hand  side  of  (56). 

By  an  easy  renewal  argument 

(57)  E{(t-Et)(.S  -b))  - r'*  - / fE(S^.  .-X)  - E(S^,,  ,-b)}P{T>n,S  eb-dx}. 

I n»0  T(x)  T(b)  n 

It  follows  from  standard  fluctuation  Identities  (especially  Feller, 

1966,  p.  570,  equation  (3.6))  that  has  a distribution  which  la 

+ 3 

strongly  non-lattice  in  the  sense  of  Stone  (1965).  Also  E(Xj^)  < “ 

3 

implies  ES^  < Hence  by  Theorem  3 of  Stone  (1965)  applied  to  the 

renewal  process  determined  by  S , equation  (54)  for  1*1  may  be 
sharpened  to  read 

(58)  E(S  - b)  - EsJ  /2  ES  - H(b)  + o(b~^  log  b)  , 

‘+ 


where 


H(b)  “ > y}dv 


is  Integrabie  at  + «.  Hence  by  (58) 


|E(S  , , - x)  - ES  /2  ES 
' l(x)  T_^  T_^' 


is  a directly  Rlemann  integrabie  function  of  x.  It  follows  from 


1 


K 


(53),  (57),  (58),  and  Theorem  3 that 

(60)  E{(t-Et)(S  -b)} / {E(S  -x)  - ES^  /2ES  }P{mln  S >-x}dx. 

^ [0,00)  ■+  V n^O  " 

Since  Z(x)  = E(S  , . - x)  satisfies  the  renewal  equation 
t(x)  ^ 

Z “ 2 + F * Z with  F(v)  = P{S  f.y},  it  may  be  shown  by  taking 
Laplace  transforms  and  making  a Taylor  series  expansion  that 

(61)  / {E(S^.  . - x)  - Esf  /2ES  }dx  = 1/^^ES^  /ES  - 1/6  ES^  /ES  . 

[0,«=)  V V % % V '+ 

and  obviously 

(62)  / P{mln  S < - x}dx  = - E{mln(0,S  ,S  , . . . ) } 

fO,»)  n>0  " 

The  theorem  follows  by  substituting  (60)-(62)  into  (56). 

Remark.  Even  In  those  cases  where  the  moments  of  S can  be 

V 

computed,  the  authors  know  of  no  general  way  to  compute  the  Integral 
appearing  in  (52).  However,  for  numerical  purposes  the  last  two 
terms  In  (52)  are  "almost  equal"  and  opposite  In  sign  and  can  prob- 
ably be  neglected.  To  see  that  they  are  "almost  equal"  observe  that 
2 

E{S  , . - x}  -*■  ES  /2ES  as  x-*-“,  and  If  this  were  actually  an  equality 
rather  than  Just  a limit  relation,  the  two  terms  would  be  equal. 

4.  APPLICATIONS  TO  SEOUENTIAL  ANALYSIS 

Theorem  4 mav  be  applied  to  yield  asymptotic  expansions  for 

the  expected  sample  size  of  a variety  of  sequential  tests.  Including 

2 

the  classical  sequential  X • E tests.  Many  of  these 
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applications  are  conceptually  similar,  and  for  brevity  only  two  have 
been  Included  here.  The  first  example  was  studied  by  Poliak  and 
Siegmund  (1975),  who  ignored  the  problem  of  the  excess  over  the 


boundary  in  their  analysis  but  otherwise  provided  a concrete  model 
from  which  Theorem  U has  been  abstracted. 

For  6 in  some  open  interval  J containing  0 assume  that 
exp (0x  - iJ/(0) ) is  a probability  density  function  with  respect  to  a 
probability  distribution  H and  that  iJj(O)  * ■ 0 and  > 0 

for  all  0.  Let  F be  a probability  on  J and  define 

f(x,t)  =■  / exp(yx  - ti|;(y))dF(y)  . 

J 


Assume  that  x^,X2i..*  are  independent,  identically  distributed  ran* 
dome  variables  such  that  for  some  0 e J - {o} 


(63) 


Ex^  - i|/’(e)  , 


and  that  F'  exists  in  some  neighborhood  of  0 where  it  is  continuous 


and 


positive.  Let  s “ I,  x,  and  Z = log  f(s  ,n) . Take 
n 1 k n n 


T+Y, 


1 2*1 

0 < Y < Y < — and  A - { I s -nit;'(0)|<n  }.  A straightforward 

1 Z Z n n 

modification  of  the  proof  of  Theorem  1 of  Poliak  and  Siegmund  (1975) 
shows  that  on  A 


Z - 6s  -ntt)(0)+log  / exp[  (y  - 6)s  - n(ij;(y)  - iK0)  ) ]dF(y) 
n n J n 


S -^logn+^log  27T(F'(6))^/i|;"(0) +u  (s  - ntj;' (0) ) ^/24»"(e)n  + . 

n Z z n n n 


Here  S • 08  - nii/(0)  and  u and  w are  random  variables  for  which 
n n n n 
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1 


with  non-random  and  converging  to 
0.  Now  assume  that  for  some  p ^ 4 

(64)  E I Xj  I ^ 

Choose  + '^y 2 — ® ^ 6 = -j  - Y^,  so 

a < mln(26,2/3).  Let  V » u (s  - nij)’ (0))^/2i[’"(0)n  + w on  A and  0 
— n n n n n 

elsewhere.  It  follows  from  (64)  and  Theorem  3 of  Baum  and  Katz 
(1965)  that  (11)  holds,  and  by  Proposition  1 that  (14),  (16),  and 
(17)  are  satisfied.  It  is  easy  to  see  that  (10)  need  not  hold  with- 
out further  assumptions,  but  it  does  hold  if  either  exp(6x  - ijj(9) ) is 
the  true  density  function  of  x^^,  l.e., 

(65)  P{xj  e dx}  “ exp(6x  ~ ij;(6)  )dH(x)  , 

2 

or  (64)  holds  for  some  p > 4 and  for  some  a >0 

(66)  i^"(6)  ^ for  all  6eJ 

That  (65)  implies  (10)  follows  from  Lemma  3 of  Poliak  and  Slegmund 
(1975).  A simple  application  of  the  Haj ek-Renyl-Chow  Inequality  to 
modify  the  proof  of  their  Lemma  7 shows  that  (64)  with  p > 4 and 

(66)  imply  (10).  Hence  by  Theorem  4 as  b -*•  “ 

I(0)E(T)  - b+-|[log(b/I(e))  - log{2TT[F’(e)]^/iJ)"(0)}  -o^/ii)"(0)] 

(67) 

+ ES^  /2  ES  + o(l)  , 

^+ 

where  1(0)  » 0ii<*(0)  - 4'(0)  and  0^  - Var  x^. 

\ 
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was 


The  approximation  (67)  without  the  term  involving  S 

given  by  Poliak  and  Slegmund  (1975).  Classical  random  walk  theory 

2 

leads  to  an  evaluation  of  ES  /2 ES^  in  terms  of 

'+  ' + 


(bS) 


00  —1 

r.,  n / S dP 
1 (S  <0)  " 


which  In  general  is  verv  difficult  tc  compute.  For  the  special  case 
in  which  the  are  N(0,i), 


((>9) 


where 


ES^  /2ES^  = 2 + e^/2  - 26  8(6/2) 


_ 1 1 1 
B(6)  = S"  {n  ^ <()(0n^)  - 6 $(-60^)} 


A brief  table  of  values  for  B is  given  by  Slegmund  (1975).  A simple 
useful  approximation  is  given  by 


ES  n ES 
"‘a- 


0(. 584  + 0/8)  + o(0  ) 


(0^0) 


For  the  numerical  values  considered  in  Tables  1 and  2 of  Poliak  and 

2 

Slegmund  (1975),  use  of  the  term  ES  /2  ES  reduces  an  error  of 

^+  V 

about  10%  by  a factor  of  roughly  one  half.  Except  for  special  cases 
computation  of  this  term  is  quite  difficult  and  perhaps  not  worth 
the  necessary  effort.  This  is  in  marked  contrast  to  the  approxima- 
tion of  error  probabilities,  where  analyzing  the  excess  over  the 
boundary  can  lead  to  dramatic  improvement  in  the  accuracy  of  the 
approximation  (cf.  Slegmund,  1975,  or  part  I of  this  paper). 
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The  second  example  Involves  a stopping  rule  suggested  by 

Slegmund  (1977)  for  testing  whether  a normal  mean  Is  0 when  the 

variance  Is  unknown.  Let  be  Independent  and  normally 

distributed  with  mean  p and  variance  o . Put  s = x,  + . . . + x , 

n 1 n 

X ” n s , s = (s  -npl/O,  v = n E,  (x x ) , 
n nnn  n Ikn 

t*  = E?(x,  - n,  and  9 = u/o.  Let  Z = n/2  1 ogf  1 + x^/v^ } , 

n 1 k n n n 

and  for  m > 3 define  T = T(b)  =»  lnf{n:n>m,  Z >b}.  Obviously 
— — n 

Z = n/2  g(x  , n ^ xf ) , where  g(x,y)  = - log(l-x^/v).  Expanding 

n n l K 

' ~2  ~2 

g in  a Tavlor  series  about  (u,  0 + p ) and  collecting  terms  yields 


Z = -I  logd  + 0^)  + 9(1  + 9^)"^  s*  - 0^(1  + 9^)“^  t* 

n 2 n 2 n 

+ |(l  + 0^)“^(l  + 0‘^)s*^/n  +i(H-9^)'^  0^(0^  + 2)t*^/n 
2 n 2 n 


- (1  + 9^)"^  0s*  t*/n  + w 
n n n 

2 3 2 3 

where  |w  I < W(n  s*  +n  It*  ) for  some  function  W which  equals 
' n ' — ' n ' n ' 

0 at  0 and  is  continuous  there. 

Let  A » {n  ^ I s*  I ^ < e , n ^lt*|^<e  },  where  c ' 0 suffi- 
n ' n'  n ' n'  n n 

2 

ciently  slowly  that  (11)  holds.  Let  S = n/2  log(l  + 0 ) 

+ (1  + 0^)"^  9s*  - l/2(l  + 0^)"^  9^  t*.  = R*^/n,  = t*^/n, 

n n n n n n 

/ 

and  V • s*  t*/n.  Also  let 
n n n 

V - + + 0^(9^  + 2)V^^^  - 20V^^^}  + w 

n 2 n nnn 


on  A and  0 elsewhere.  With  the  aid  of  the  identity 
n 

2V^^^  » (s*+t*)^/n  - and  Proposition  1 it  is  easy  to 

n n n n n 

check  that  for  i - 1,2,  and  3 and  hence  V satisfy  (14)-(17). 

n n 
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As  in  the  preceding  example  (10)  requires  a special  argument.  Let 
denote  the  probability  under  which  the  x's  have  expectation  U = 0.  From 
the  trivial  inequality  P_{T  < n}  < zf  P,x{7.,  > b}  and  an  analysis  of 
the  tail  of  the  t-distribut ton , it  may  be  shown  for  x > 0 that 

_l 

(6ft)  P.{T^bx}  = 0(b^  exp[-  b(l--)]) 

U ID 

as  b - By  Lemma  3 of  Poliak  and  Siegmund  (1975),  for  arbitrary 
0 # 0 and  V > 0 

1 

(69)  p{T_  n}  £ 1 - <I>(y)  + exp(9^n/2  + y0n^)PQ{T^n} 

1/4 

Putting  y = b in  (69)  and  appealing  to  (68)  yields  (10)  for  any 
<5  < 20  ^(1  - 2/m).  Hence  by  Theorem  4,  for  9^0  and  m _>  3 

(70)  log(l  + 0^)ET  = 2b- 1 + e^/(l  + 9^)^  + ES^  /2  ES  + o(l)  , 
as  b -*■  «>. 


5.  COMPARISON  WITH  WOODROOFE's  RESULTS 

The  purpose  of  this  section  is  to  discuss  briefly  the 
relation  of  the  results  of  this  paper  to  similar  results  obtained 
recently  by  Woodroofe  (1976a,  1977)  by  completely  different  methods. 
In  general  terms  the  methods  of  this  paper  and  its  companion  develop 
renewal  theory  for  non-linear  functions  of  a random  walk  by 
expanding  the  function  and  applying  classical  renewal  theory  to  the 
dominant  linear  term.  In  contrast  Woodroofe  considers  the  first 


1 


■■X 


f 


passage  of  a random  walk  S to  a non-linear  boundary  which  he 

n 

analyzes  by  expanding  the  boundary  around  an  appropriate  point.  One 
consequence  of  this  difference  in  formulation  Is  that  in  this  paper 
and  its  companion  a fairly  small  number  of  theorems  provide  a uni- 
fied theory,  whereas  Woodroofe  is  required  to  reapply  his  method 
with  Its  fairly  elaborate  computations  to  deal  with  different  stop- 
ping rules.  A technical  difference  is  that  Woodroofe  requires  a 
blanket  smoothness  condition  on  the  distribution  of  his  random 
variables,  which  has  no  counterpart  in  the  present  development. 

Other  technical  differences  are  described  below. 

Let  Xj^,X2,...  be  independent  Identically  distributed  random 

- ~2 

variables  with  positive  expectation  p and  finite  variance  O . Let 

s = X,  + . . . + x . Woodroofe  (1976a)  studies  the  behavior  of  the 
n 1 n 

stopping  rule 

(71)  T ’*lnf{n:s>cn''^}  (c>0,  0<Y'^1) 

In  — 

as  c (Actually  for  some  results  a slightly  more  general  class 

of  stopping  rules  is  considered,  but  since  Woodroofe  gives  no  appli- 
cation for  these  more  general  rules,  and  since  their  introduction 
would  complicate  this  discussion,  they  have  been  omitted.) 

Statistical  applications  of  the  stopping  rule  (71)  have  been  des- 
cribed by  Woodroofe  (1976b)  and  Slegmund  (1977).  Under  the  addi- 
tional restriction 

(72)  P{x^<0}  - 0 . 

Woodroofe  (1977)  studies  the  behavior  of 

I 

I 
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(c>0,  y > I, 


(73)  T_  - inf  {n  : n > ra,  s cn'’^L(n) } 

2 — n 

as  c ^0,  where  L(n)  » 1 + const. /n  + o(n  S as  n -►  Both  (71) 
and  (73)  may  be  written  In  the  form 

(74)  T - Inf{n:n  m,  (n+(S  + 6 )(t(n  )>b}  , 

~ n n 

where  g(x)  » (x^)^^^^  b - r(c),  and  6^  -*■  0.  Suppose  more 
generally  that  g : (-*,“')  ^ [0,“')  Is  three  times  continuously  dif- 
ferentiable in  a neighborhood  of  p and  that  g'fp)  ^ 0.  Let  C -*•0 

n 

— 2 "*’3 

and  A ■ {n  Is  - np  j <c  }.  By  Tavlor's  theorem,  on  A 
n ' n ' n n 

_i  ~ ~ -np)^ 

ng(n~  s ) - ng(p)  + (s  -np)g'(p)  + — g"(u)  + *>  , 

n n .cn  n 

”2  *^3 

where  Iw  < W(n  Is  - np  ) for  some  function  W which  vanishes  at  0 
n — ' n ' 

and  is  continuous  there.  Let  S - ng(p)  (s  -np)g'(p)  and 

n n 

-2  -1 

V - (s  - np)  /2n  + (<5  + 6 )g(n  s ) on  A and  0 otherwise.  It  nay 
n n n n n 

be  shown  as  in  the  second  example  of  Section  4 with  the  aid  of 

Proposition  1 that  for  suitable  e (11)  and  (14)-(17)  are  satisfied 

n 

I 1 4 

with  a • 2/3,  provided  E|x^(  < <».  Thus  Theorem  4 applies  to  give 

an  asymptotic  expansion  for  E(T)  provided  that  (10)  holds,  and  as 
always  a special  argument  is  required  here. 

For  the  stopping  rules  (71)  and  (73)  proofs  of  (10)  under 
appropriate  conditions  follow  from  Woodroofe  (1976a,  Lemma  7.1  and 
1977,  Lemma  2.3).  Use  of  the  Haj ek-Reny 1-Chow  inequality  (cf.  Chow, 
Robbins,  and  Slegmund,  1971,  p.  25)  together  with  (50)  would 
simplify  these  arguments. 
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Hence  Woodroofe's  expansions  of  ETj  and  ET^  follow  from 
Theorem  4. 

In  Woodroofe's  work  a central  role  Is  played  by  results 
resembling  Theorem  3,  which  form  the  basis  for  subsequent 
calculations.  One  example  Is  Theorem  3.1  of  Woodroofe  (1976a), 
which  says  Chat  If  E(xj|  < and  Woodroofe’s  blanket  smoothness 
condition  is  satisfied,  then  for  T^^  defined  by  (71) 


(75) 


I,  P{T  >n,  s >cn^-y}  -*■ 

11  n 

[(1-Y)1j]~^  P{s  > nYli  - X 
-y  n — 


for  all  n > l}dx 


Deriving  (75)  from  Theorem  3 requires  the  slightly  stronger  moment 
condition  e|xj^|^  < °°  for  some  p ^ 1 + 5^^^,  With  (71)  rewritten  in 

•y 

the  form  of  (74)  (with  6 » 6 » 0)  the  inequality  s > cn  - y 

n n 

becomes  Z - ng(n  ^s  ) > (b^  ^ - yn  Y)  ^ proof  of 

n n 

Theorem  2,  It  is  easily  shown  that  only  the  terms  with  £ n < n^, 
where  n^^  and  n2  are  defined  in  (21),  are  non-negllglble  in  evalua- 
ting the  limit  of  the  left  hand  sides  of  (75).  For  these  values  of 

1 “Y  “ Y 1 / 1“Y 

n,  which  are  ~ b/u,  a simple  expansion  gives  (b  - yn  ) 

Y 

= b - p y/(l-Y)  + o(l).  Now  Theorem  3 and  a simple  change  of 
variable  yield  (75).  A similar  argument  applies  to  the  stopping 
rule  of  (73) . 
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ttCuniTv  CLktsiriCATioM  or  This  paoc  iviim  Dm* 


ABSTRACT 


This  paper  continues  earlier  work  of  the  authors.  An 

analogue  of  Blackwell's  renewal  theorem  is  obtained  for  processes 

Z “ S + C , where  S Is  the  n*’^  partial  sum  of  a sequence 
n n n n i-j  ^ 

n 

of  independent  identically  distributed  random  variables 

with  finite  positive  mean  and  ^ is  Independent  of  X . , ,X  and 

n n+1  n+^ 

has  sample  paths  which  are  slowly  changing  in  a sense  made  precise 
below.  As  a consequence,  asymptotic  expansions  up  to  terms  tending 
to  0 are  obtained  tor  the  expected  value  of  certain  first  passage 


times.  Applications  to  sequential  analysis  are  given 


